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(54) METHOD FOR DETECTING LINE SEGMENT 

(57)Abstract: 

PROBLEM TO BE SOLVED: To reduce computer storage capacityalso to 
shorten computer processing time and to reduce the effect of noise by calculating 
an edge point that is equal to or more than threshold from the intensity of a 
differential value of an edge point and acquiring an image data that has 
inclination direction components. 

SOLUTION: An edge image is acquired by performing image differential 
processing of image data that is inputted with a cameraetc. The image differential 
processing acquires vertical differential image data and horizontal differential 
image data. The intensity of a differential value in each pixel is calculated based 
on the two differential image data and simultaneouslythe inclination direction of a 
differential point is calculated. An image that is maximum to a neighborhood point 
is defined as an edge maximum point in image data that shows differential 
intensity. A point that has a differential value which is larger than threshold which 
is preliminarily specified among edge maximum points acquired in such a way is 



made an edge pointand a set of those edge points is an edge image. The 
inclination direction of edge points in an edge image is acquired from image data 
that show the inclination direction of differential points and produces an edge 
image that has inclination direction components. 



CLAIMS 



[Claim(s)] 

[Claim 1]Carry out a picture differential process of a lengthwise direction and a 
transverse direction per image dataand it asks for strength of a differential value 
for every pixeland a gradient direction of a differentiating pointA detecting method 
of a line segment provided with the technique of obtaining an edge image which 
searches for an edge point of having the maximal value of this differential 
valuesearches for an edge point more than a threshold from strength of a 
differential value of this edge pointand has a gradient direction ingredient. 
[Claim 2]A detecting method of the line segment according to claim 1 which 
acquires uniquely a transformation coordinate (thetarho) in the Hough flat surface 
by x-y coordinates and the gradient direction theta of an edge point. 
[Claim 3]A detecting method of the line segment according to claim 2 which takes 
difference with a central point position of a picture for x-y coordinates of an edge 
pointconsiders the gradient direction thetaand acquires a transformation 
coordinate in the Hough flat surface. 

[Claim 4]A detecting method of the line segment according to claim 2 which 
considers an error of error deltatheta of a gradient directionand x-y 
coordinatesestablishes a virtual vote flat surface of a certain area on the Hough 
flat surfaceand was made to change edge dot data at this flat surface (vote). 
[Claim 5]A detecting method of the line segment according to claim 4 which was 
made to cast its vote at two or more virtual vote flat surfaces per edge point. 
[Claim 6]A detecting method of the line segment according to claim 4 or 5 which 
counts the number of times of vote in a virtual vote flat surfaceand removed a 



virtual vote flat surface of the number of times below a threshold. 

[Claim 7]A detecting method of the line segment according to claim 4 which was 

made to cast its vote at one virtual vote flat surface per edge point. 

[Claim 8]A detecting method of the line segment according to claim 5 which 

constituted a data constellation and a voting data group of the number of this 

virtual vote flat surfaceand each virtual vote flat surface in vote to a virtual vote 

flat surface. 

[Claim 9]A detecting method of the line segment according to claim 7 which 
constituted a data constellation and an edge-data group of this virtual vote flat 
surface in vote to a virtual vote flat surface. 

[Claim 10]A detecting method of the line segment supposing edge information 
missing with data within a virtual vote flat surface according to claim 4. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the lnvention]When carrying out feature extraction of this invention in 
what is called image processingit relates to the method of extracting the linear 
components in an edge image. 

It is related with the calculation method which presumes the linear components 
stabilized especially at high speed. 

[0002] 

[Description of the Prior Art]ln image processingextracting the straight line and 
line segment as a feature is widely performed in various fields from the image 
data inputted with the camerathe image scanneror the image acquiring device. 
For examplealthough a straight linea circlea characteretc. are extracted from the 
raster data of the drawing inputted from the image scanner and being individually 



changed as CAD data in a drawing readerrespectivelyprocessing which extracts 
a straight line and its line segment made a part from drawing data at this time is 
performed. In the image inspection devicewhen inspecting the position and 
direction of a portion of a line of an object partfor examplea line segment is 
detected out of the edge image obtained from the image data inputted from the 
image acquiring device by detecting edgethe position and direction are 
measuredand comparison checking is conducted. 
[0003]Thusalthough the processing which extracts a line segment is 
indispensablethe method of applying a straight line and a line segment so that 
what is called the least square method may be applied based on the coordinates 
of a set of the point assumed to constitute a line segment in any case and an 
error with a straight line or a line segment may become within constant value is 
common. The method of calculating the straight line or line segment which 
should be especially applied based on the coordinates of a set of a point at high 
speed is proposed by these people (Japanese Patent Application No. No. 
251241 [ eight to ])When the set of a point exists as a series of sequence of 
pointsthese sequence of points are applied as one straight line or a line 
segmentand when the set of a point exists as two or more sequence of pointsthe 
technique of detecting sequence of points as an individual line segment is 
proposed. 

[0004]Methods of generally reducing the influence of a noise also include the 
method of applying what is called Hough transformation. The point which forms a 
line segment is expressed as a fixed point along which the track group expressed 
with the parameter passesand this method obtains a parameter expression 
curveand specifies a line segment. 

[0005]Anywayit is in an edge imageand each point has distinguished whether it 
exists on the straight line extracted from sequence of pointsor a line segmentand 
he is trying to remove the point of having been confused under the influence of a 
noise. 
[0006] 



[Problem(s) to be Solved by the lnvention]When extracting a line segment from 
an edge imageand judgment of being a noise is a difficult problem in additionfor 
examplea line segment is extracted out of an edge imagethe segment string 
which should be essentially extracted as one line segment may be extracted as 
two or more segment groups by the influence of the noise mixed in the picture. 
Even if a photograph is moreover taken under the same image acquiring 
condition also where the same object is installed in the same position and 
direction since this development is caused by the noisethe length and the 
position of a line segment which are extracted out of an edge image may differ 
from each other. For this reasonsince the same line segment may not be 
extracted when conducting the inspection of the position and direction of an 
object partfor example with an image inspection devicethere is a problem that a 
stable inspection is not guaranteed. 

[0007]The local information on an edge image may be missing by mixing of a 
noiseand there may be a point which is not recognized as edge by the influence 
in which the contrast of the picture acquired in addition to the noise is still more 
insufficient. Many phenomena of this latter are generated about the picture 
acquired in the environment where it is influenced by an extraneous light. In the 
object recognition in the factory which may picturize under available lightsuch as 
sunlightwhen acquiring a picture especially using a camerafor exampleis not 
shadedthe problem in industrial application also has that the influence on edge 
detection is great etc. 

[0008]lt is raised by the technique of having applied the above-mentioned Hough 
transformation as a line segment extraction method which is learned now and 
cannot be easily influenced by a noise as a methodand this techniqueWhen (xiyi) 
express the coordinates of the arbitrary edge points in an edge image with x-y 
coordinates concretelylt is considered as the fixed point where the track group 
expressed with the parameters theta and rho passes along this pointa parameter 
expression curve is obtained with theta-rho coordinatesa line segment is 
specifiedthis transformation coordinate (thetarho) consists of the angle theta and 



the distance rho to a fixed pointand coordinate transformation processing is 
performed. That iscoordinates (xiyi) are changed into the transformation 
coordinate (thetarho) which is the Hough (theta-rho) flat surfaceand a following 
formula (1) is obtained. 
Rho=xi sin theta+yi and cos theta ... (1) 

Drawing 1 shows the example which expressed the fixed point of x-y coordinates 
at the Hough flat surface. A transformation coordinate (thetarho) is one curve like 
a graphic display. 

[0009]Although the operation which projects here the combination searched for 
from x-y coordinates by the above-mentioned (1) formula (thetarho) to the Hough 
flat surface is called "vote"when performing this voting operation by computer 
processinga theta-rho flat surface is divided in the shape of a latticeand the 
number of times which assigned and voted that lattice for the computer storage 
area is counted and memorized. And about ballot resultsa group [ that there are 
many votes relatively (thetarho) ] is recognized as a parameter showing line 
segment vote matter. 

[0010]Howeverthe problem in the above-mentioned Hough flat surface is as 
follows. It is needing very many computer storage capacities in the first place 
firstsince a lattice-like theta-rho flat surface's is constituted. In order to lessen a 
computer storage capacityit is solved by reducing the number of latticesbut it is 
necessary to enlarge unit width of the value of theta and rhoand there is a 
problem which causes reduction of accuracy. As the second problemit is that 
much computation time is needed. This is because the group given by (1) 
formula by the number of times of vote about one edge point increasing 
dramatically (thetarho) is in a theory top infinite number. 

[001 1]ln performing vote by Hough transformation in view of an above-mentioned 
problemthis invention decreases a computer storage capacityand shortens 
computer processing timeand provides the detecting method of the line segment 
which reduced the influence of a noise. 

[0012]This invention which attains the above-mentioned purpose has the 



following invention specific matter. 

(1) Carry out the picture differential process of a lengthwise direction and a 
transverse direction per image dataand it asks for the strength of the differential 
value for every pixeland the gradient direction of a differentiating pointThe edge 
point of having the maximal value of this differential value was searched forthe 
edge point more than a threshold was searched for from the strength of the 
differential value of this edge pointand it had the technique of obtaining the edge 
image which has a gradient direction ingredient. 

(2) Acquire uniquely the transformation coordinate (thetarho) in the Hough flat 
surface by the x-y coordinates and the gradient direction theta of an edge point in 
d). 

(3) In (2)take difference with the central point position of a picture for the x-y 
coordinates of an edge pointconsider the gradient direction thetaand acquire the 
transformation coordinate in the Hough flat surface. 

(4) In (2)the error of error deltatheta of a gradient direction and x-y coordinates is 
consideredthe virtual vote flat surface of a certain area is established on the 
Hough flat surfaceand it was made to change edge dot data at this flat surface 
(vote). 

(5) In (4)it was made to cast its vote at two or more virtual vote flat surfaces per 
edge point. 

(6) In (4) or (5)the number of times of vote in a virtual vote flat surface is 
countedand the virtual vote flat surface of the number of times below a threshold 
was removed. 

(7) In (4)it was made to cast its vote at one virtual vote flat surface per edge point. 

(8) In (5)the data constellation and voting data group of the number of this virtual 
vote flat surface and each virtual vote flat surface were constituted in the vote to 
a virtual vote flat surface. 

(9) In (7)the data constellation and edge-data group of this virtual vote side were 
constituted in the vote to a virtual vote flat surface. 

(10) Assume the edge information missing with the data within a virtual vote flat 



surface in (4). 

[0013]ln this inventionif it is stabilizeda straight line or a line segment is extracted 
and it puts in another way even if there is disorder of the edge image by mixing of 
a noisea straight line and a line segment will be stably extracted for mixing of a 
noise as a premise. For this reasona differential process is performed about the 
picture first acquired from the image acquiring deviceand it asks for the strength 
and gradient direction of a differential value. Nextits vote is cast to the virtual vote 
flat surface introduced on the improved Hough flat surfaceand linear components 
are extracted. And a line segment is detected based on the edge data for which 
its vote was cast at this virtual vote flat surface. It is adopted also as the 
technique of attaining improvement in the speed of processing. 
[0014] 

[Embodiment of the lnvention]Herewith reference to drawing 2 - drawing 1 1 it 
explains per example of an embodiment of the invention. Firstabout the image 
data inputted by the camerathe image scanneror the image acquiring devicea 
picture differential process is performed and an edge image is obtained. In this 
picture differential processeach of the differential image data of the lengthwise 
direction which applied the one-dimensional differentiation filter to the picture 
lengthwise direction as shown in drawing 2 and the differential image data of the 
transverse direction which applied the one-dimensional differentiation filter to the 
picture transverse direction is obtained. The differentiated data corresponding to 
the edge of a transverse direction or a lengthwise direction is obtained by this 
lengthwise direction differentiation and transverse direction differentiation. 
[0015]Nextbased on these two differential image datathe mean square of the 
differential value of a lengthwise direction and a lateral differential value is 
calculated for every pixeland it asks for the strength of a differential value. It can 
comesimultaneously the gradient direction of the differentiating point for every 
pixel is calculated based on the value of the differentiated data of the lengthwise 
direction for every pixeland the value of lateral differentiated data. By these two 
calculationstwo image datathe image data which shows the strength of a 



differential valueand the image data which shows the gradient direction of a 
differentiating pointwill be obtained. Finallyin the image data which shows the 
strength of differentiationthe picture which is the maximum will be defined as an 
edge maximum point to a point soon. Herea point will point out soon two points 
located in the direction of the image data which is located in the edge pole great 
neighborhood of a pointand shows the gradient direction of a differentiating point. 
[0016]ln this waythe point of having a bigger differential value than the threshold 
beforehand specified among the obtained edge maximum points is made into an 
edge point. In this waya set of the acquired edge point is an edge image. In this 
casethe gradient direction of the edge point in an edge image can be obtained by 
referring to the image data which shows the gradient direction of the above- 
mentioned differentiating point. As a resultthe edge image which has a gradient 
direction ingredient will be generated. 

[0017]thetai Nextfor taking lessons from conversion (vote) of the Hough flat 
surfaceand statingset to (xiyi) the x-y coordinates of the arbitrary edge points in 
the edge image produced by making it aboveand carry out the gradient direction 
which this edge point has. This gradient direction is obtained like the above- 
mentioned by referring to the image data which shows the differential direction of 
length and width. In this wayconversion to a transformation coordinate (thetarho) 
is performed by using xiyiand thetai. 
rhoi=xiandsin thetai+yi-cos thetai ... (2) 

it obtains by this (2) formula - having (thetai. rhoi) ~ one point is expressed in a 
transformation coordinateand if xiyiand thetai are decidedrhoi will be determined 
inevitably. That isthe coordinates in the Hough flat surface are determined by 
generation of the edge point of having a gradient direction ingredientand 
processing time and the amount of computations are reduced substantially. As 
for the above resultshortening of processing time and reduction of the amount of 
computations are achieved by searching for the vote point coordinates 
(thetairhoi) of the Hough flat surface in quest of the gradient direction of an edge 
point using the value. 



[0018]Nextin having been in charge of generating the edge image which has the 
direction component mentioned aboveand acquiring a transformation coordinate 
using thisshortening of processing time and reduction of the amount of 
computations were achievedand the high-speed coordinate conversion method 
was obtainedbut improvement in calculation precision is aimed at further here. In 
asking for the gradient direction of the above-mentioned differentiating pointthe 
case where errorssuch as an error of measurementa calculation erroror a 
noiseare included in the computed gradient direction data is assumed. The value 
change of rho which sets to deltatheta the error included in theta based on this 
assumptionand is caused by this error is set to deltarho. 
[0019]At this timethe relation between delta theta and delta rho is as follows. 
deltarho=deltatheta- (drho/dtheta|theta=thetai) ... (3) 

Herethe formula of d rho/d theta|theta=theta i expresses the differential value of 
rho to theta in the case of theta=theta i. Therefored rho/d theta is as follows, 
d rho/d theta=-x-sin theta+ycos theta =square root and (x 2 +y 2 ) sin (psi-theta) 
Psi=arctan (y/x) ... (4) 

In this case(xy) are edge point coordinates and theta expresses the gradient 
direction of an edge point. From above-mentioned (3) and (4) typeit becomes 
clear that variation delta[ of rho ] rho receives big influence in error delta[ of 
theta ] theta when the value of (x 2 +y 2 ) is large. For this reasonin order to reduce 
the influence by this errorthe following (5) types are applied instead of the above- 
mentioned (2) types. 

rhoi=(xi-x m ) cos thetai+(yi-y m ) sin thetai ... (5) 

Howevercoordinates (x m ym) express the central point position of a picture as 
shown in drawi ng 3. comparing each absolute value of this (5) type xi x m and yi- 
y m with the absolute value of xi or yi - the full screen - an average of - since it is 
set to one half - the value of above-mentioned (4) type d rho/d theta - 1 -/square 
root It is set to (2). And deltarho of (3) types is 1 -/square root similarly. It 
becomes a value of (2). As a resultcomputation accuracy is square root by (5) 
types. It (2)-double-improves. 



[0020]Nextlessons is taken from introduction of the concept of a ballot boxand it 
states. In the segment detection method using the conventional Hough 
transformationone curve (thetarho) obtained by the above-mentioned (1) formula 
based on (xy) is voted for the Hough flat surface. The point (thetairhoi) similarly 
acquired by the above-mentioned (2) types or (5) formulas is voted as one point 
of the Hough flat surface. For this reasonit is as having stated above for the 
composition of the Hough flat surface to need the amount of computations and 
processing time immense in the formerand to need a huge computer storage 
capacity. Unlike the case where xiyiand thetai are determined without the error 
which carried out point **and rhoi is decidedthis leads to increase of a computer 
storage capacityand a throughput and processing time increasealso when error 
deltatheta and variation deltarho which are contained in the above-mentioned 
gradient direction theta exist. Thenthe concept of a virtual vote flat surface (it is 
considered as a ballot box below) is introduced in order to suppress these 
increasesand reduction of the computer storage capacity which needs 
improvement in the speed of processing is aimed at. 

[0021]About a series of sequence of points which should be essentially extracted 
as one line segment at a x-y flat surfacewhen an error is included in the gradient 
direction of each edge pointinaccuracy deltatheta contained in theta is assumed 
and amount of value changes delta[ of rho ] rho is assumed. When voting for the 
Hough flat surface every point of the sequence of points included this errorthe 
value of theta axis serves as vote in within the limits of a between [ theta-delta 
theta and theta+delta theta ] by that vote. At this timeit is in rho axisthe value of 
deltarho is obtained by the above-mentioned (3) formulas 
(drho/dtheta|theta=thetai)i.e. delta rho=delta theta-andfor this reasonthe value of 
rho serves as a following formula (6). 

Rho=x-cos thetai+ysin theta+deltatheta- (drho/dtheta|theta=thetai) ... (6) 
Thereforeone line segment which is the range of theta-deltatheta and theta+delta 
theta can be expressed at the Hough flat surface from (6) types. 
[0022]ln consideration of a quantization error or the error by a noisedelta x and 



delta y are introduced about the value of the coordinates x and y of the point in 
an edge image. In this casechange deltarho' under the influence of delta x and 
delta y is called for with a following formula (7). 
deltarho -delta x-cos theta+delta ysin theta ... (7) 

As a resultthe field at the time of its vote being cast for the sequence of points 
which included the error by (6) types and (7) formulas at the Hough flat surface 
turns into a field shown in drawing 4 and the size of a ballot box is decided. By 
setting up one ballot box per sequence of points originally recognized as one line 
segment by introducing a ballot boxEven if it included the errorits vote will be cast 
to the inside of one ballot boxand the computer storage capacity which needs the 
conventional theta-rho flat surface as compared with the method of dividing in the 
shape of a lattice and memorizingfor example has decreased extremely. 
[0023]Although the case where there was a line segment which should be 
extracted as a part for the edge image median line was assumed about the 
above-mentioned explanation of introducing a ballot box in consideration of an 
errorwhen two or more line segments existits vote will be cast by generating two 
or more ballot boxes. But about an ideal edge imagethe ballot box of the line 
segment which should be extractedand the same number is generated. Drawing 
S^shows generation and the vote procedure of the ballot box. It states below. 
[0024](1) Judge first whether there is any ballot box. 

(2) Herein the state where one does not exista ballot box generates a new ballot 
box in accordance with the method mentioned aboveand casts its vote for the 
box. 

(3) On the other handwhen one or more ballot boxes existjudge whether the 
coordinates (thetarho) to vote are in the inside of a box. 

(4) When these coordinates (thetarho) are in the inside of a ballot boxcast your 
vote as it isin being outsideit generates a new ballot boxand cast your vote for 
that box. 

(5) The ballot box generated still more later laps with the existing ballot boxand a 
field may be shared. 



In this caseits vote is cast also for the existing box. In this wayabout two or more 
ballot boxesvote of all the edge points will be performed and all the edge points 
will be voted by any one or more ballot boxes. 

[0025]Linear components are extracted as a result of the vote to a ballot box. A 

linear equation is called for using the center coordinates (thetarho) of a ballot box. 

A following formula (8) is an inverse transformation type of the coordinates at the 

time of using the above-mentioned (2) typesand (9) types are inverse 

transformation types of the coordinates at the time of using (5) types. 

y=-x/tan theta+rho/sin theta ... (8) 

y=- (x-Xm) / tan theta+rho/sin theta+y m ... (9) 

Drawing 6 expresses the relation between the straight line based on (9) types at 
the time of setting up a center position for error reduction (refer to drawing 3) and 
each parameter. In this waythe number of the edge points which constitute the 
straight line becomes clear by counting the vote in a ballot box. In order to 
recognize a ballot box with few votes as a noisethe threshold of the number of 
votes is providedand a straight line is detected based on a ballot box with the 
vote more than a threshold. In this waylinear detection is performedwithout 
influencing the ingredient which should be detected as a straight line and which 
does not come out by the ingredient which should be removed and detected and 
which does not come out. 

[0026]lt is necessary to memorize the information on a ballot box fieldand the 
information on the edge point for which its vote was cast to a ballot box in 
addition to memory of the number of votes. Drawing 7 shows the example of 
composition of a ballot box data constellation. What is memorized to ballot box 
data is a leading address of the parameters delta theta and delta rho showing the 
number of boxes and the size of a box which were generatedand the storage 
capacity part which stores a ballot box data constellation. By adopting such a 
memory methodthe total of a ballot box can be increasedas long as a computer 
storage capacity allows. The element memorized by each ballot box is a leading 
address of the storage capacity part which stores in the stop of a ballot box 



coordinates theta+ of the side of the both sides in alignment with a value 
(thetamrhom) and theta axis of the ballot box and theta-inclination 
drho/dtheta|theta=thetai of the medial axis of a ballot boxthe number of votes 
obtainedand the edge data for which its vote was cast. As an element of each 
edge datathe position (xiyi) of an edge point and edge gradient direction thetai 
are memorized. With constituting a data storage part as mentioned 
aboveextraction of linear components and detection of a line segment are 
performed efficiently. 

[0027]ln generation of two or more ballot boxes shown in drawing 5 mentioned 
aboveextraction of the straight-line portion of the drawing 6 type (8) and (9)and 
the composition of the ballot box data constellation shown in drawing /Each line 
segment can recognize the edge section whichso to speakadopts two or more 
voting systemsand two or more line segments share of casting a vote for two or 
more ballot boxes about one edge pointand there is an advantage by which 
division-ization of a line segment is controlled by recognizing the section where 
each line segment is the same. On the other handwhen putting a chief aim on 
reduction of the computer storage capacity to need and the amount of 
computationsor shortening of computation timeit is good to be based on 
generation and the vote procedure of the ballot box of drawing 8 . Namely(1) It is 
judged first whether a ballot box exists. 

(2) In the state where one does not exista ballot box generates a ballot box by 
the method mentioned aboveand casts its vote for the box. 

(3) When one or more ballot boxes existjudge whether the coordinates (thetarho) 
to vote are in a box. 

(4) When the coordinates are in a ballot boxcast your vote as it iswhen it is 
outsidegenerate a new ballot boxand cast your vote for the box. 

By the above proceduresvote is performed about all the edge points. Edge points 
will be voted [ no ] by one of one ballot boxesand are voted for the same edge 
point as two or more ballot boxes like the example of drawing 5 . 
[0028]Drawing 9 shows the example of composition of the ballot box data 



constellation which aimed at cleanup cost reductionand has put the chief aim on 
reduction of the computer storage capacity to need. The necessity of memorizing 
the information on a ballot box field and the information on the edge point for 
which its vote was cast to a ballot box in addition to memory of the number of 
votes is **. What is memorized to ballot box data is a leading address of the 
parameters delta theta and delta rho showing the number and size of the 
generated boxand the storage parts store which stores a ballot box data 
constellation. The element memorized by each ballot box is the leading address 
and the last address of the storage parts store which stores coordinates theta+ of 
the side of the both sides in alignment with the center position (thetamrhom) of a 
ballot boxand theta axis of the ballot box and theta-inclination 
drho/dtheta|theta=thetai of the medial axis of a ballot boxthe number of votes 
obtainedand the edge data for which its vote was cast. As an element of each 
edge datathey are the address of a storage parts store with which edge point 
data is storedand the address of a storage parts store with which the following 
edge point data is stored. The storage parts store in which edge point data is 
stored refers to the storage parts store which has memorized the edge image. 
Constituting a data storage part as mentioned above can extract all the linear 
components and line segments with a small storage capacity. 
[0029]ln the edge image which the noise is mixingedge dot data may be missing 
under the influence of a noise. For this reasonin the conventional method as 
edge sequence of points not always continuously located in a line and shown by 
conventional technology explanationthere is a risk of the sequence of points 
which should be essentially recognized as one line segment being detected as 
two or more line segments. In the detecting method of linear components based 
on the ballot box in old explanationthe sequence of points which should be 
essentially recognized as one line segment exist as data in the same ballot box. 
In this casesince the ballot box itself expresses linear componentsa line segment 
can be detected by extracting the element in a ballot boxand assumption of the 
divided line segment is attained. 



[0030] Drawing 10 shows the procedure (vote counting or a process of vote 
counting is called below) of extracting the element in a ballot box and detecting a 
line segment. 

(1) Align the edge point data which is an element about a position for every ballot 
box about a valid ballot box with the number of votes obtained more than a 
threshold. 

(2) While recognizing what is called continuous edge sequence of points that the 
position adjoinedrecognize the state of the divided edge sequence-of-points 
group. 

(3) Find the distance of the divided edge sequence-of-points groupsand 
recognize the sequence-of-points groups of a distance nearer than the threshold 
set up beforehand as one sequence-of-points group. 

(4) Investigate the length of each point column group and recognize sequence of 
points longer than the threshold set up beforehand as a line segment. 

It becomes possible to detect the line segment which does not have division by 
this to the edge image with which edge information was missing. 
[0031]Nextlessons is taken from discovery of the edge point which is not 
detected with shortage of contrast etc.and it states. When contrast ran shortthe 
point which is hard to recognize as an edge point may be included in the 
differential image. In the method described based on drawing 2w hen extracting 
an edge point from a differential imagethe edge maximum point below the 
specified threshold is not recognized to be an edge point. This is important and 
required workin order to reduce the point accidentally recognized as an edge 
point by the influence of a noise. Howeverin the picture for which contrast was 
insufficientsince the difference of an effective picture signal and a mixing noise is 
small (i.e. since the S/N ratio is small)the point which should be recognized as an 
edge point will be missing. It is necessary to compensate the information on the 
missing edge point for improvement in the detection ratio of a line segment. 
Especially the edge point that shortage of contrast has not been recognized 
owing to is on extension of the line segment detected by the technique to the 



preceding clause in many cases. Thenhow to search for such an edge point is 
described. 

[0032]Drawsng 1 1 expresses the procedure of searching for the edge point 
missing based on the detected line segmentand describes the procedure below. 

(1) Recognize the position of the detected line segment end. 

(2) Recognize the direction of a line segment from the position of a ballot boxand 
search for the position of the point which adjoins a line segment end in the 
direction which extended the line segment. 

(3) Judge whether the point which adjoins a line segment end is a maximum 
point. 

(4) Investigate the gradient direction of the differential value of the point which 
adjoins a line segment endand a tie judges whether it goes into the same ballot 
box as a line segment. 

(5) A tie is a maximum pointand if it goes into the ballot box in which the 
adjoining line segment is includeda tie will be added to the line segment. 

(6) When a corner point is newly addedreturn to (1) and perform the processing 
recursively. 

The edge point which was not detected as some edge sequence of points by this 
is discovered. By discovering the edge point which was not detected by 
generation of the edge imageimprovement in the detection ratio of a line segment 
is achieved. 
[0033] 

[Effect of the InventionjAs explained abovein this inventionimprovement in the 
speedreduction of a computer storage capacityand reduction of the amount of 
computations can be aimed at in detection of the line segment which used the 
Hough flat surface. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1]The diagram which illustrated the Hough flat surface. 
[Drawing 2]The flow chart of edge-data acquisition. 

[Drawing 3] The explanatory view of the image coordinates which considered 
central point coordinates. 

[Drawing 4] The explanatory view of the virtual vote flat surface (ballot box) in 
theta-rho coordinates. 

[Drawing 5]Generation of a ballot boxand the flow chart of a vote procedure. 
[Drawing 6] The explanatory view of the inverse transformation at the time of 
considering central point coordinates. 

[Drawing 7]The explanatory view of the example of composition of a ballot box 
data constellation. 

[Drawing 8] The flow chart in the case of casting one's vote for one ballot box per 
edge point. 

[Drawing 9] The explanatory view of the example of composition of a ballot box 
data constellation. 

[Drawing 10]The flow chart of a process of vote counting. 

[Drawing 11]The search flow chart of the edge point which is not detected. 

[Description of Notations] 

xy x-y coordinatesor an axis of coordinates 

x m y m central point coordinates 

thetarho Hough plane coordinates 
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